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Sm-mRY AND CONCLUSIONS 



Problem 

The goals of this study wei'e (l) to compare two instructional strategies 
for individualizing computer assisted instruction (CAl) training materials 
and (2) to evaluate the effect of providing a lesson narrative before 
training. 

Background 

This development effort is a part of a program in which a number of CAI 
instructional strategies are being developed and tested for basic elec- 
tronics training. Two types of adaptive instructional strategies were 
compared: (l) the student selected his own training and (2) the course 
prograan controlled training for the student based on his pretest resixlts. 
The influence of having the student read a narrative overview of training 
content before CAI instruction on each lesson was also examined. The ' 
subject matter consisted of AC series circuits in the Basic Electricity/ 
Electronics (BE/E) School, and the course materials vehicle was a modified 
version of the previously developed CAI "AC Series Circuits and Resonance 
. Module." 

Approach 

Ninety--six students from BE/E School were divided into four instructional 
strategy groups for taking the 11 lesson CAI Module. 

One training strategy allowed the student to select his training from 
an index of descriptive lesson objectives. A second training strategy 
pretested the student immediately before each lesson objective and 
branched him to appropriate training sequences on the basis of his test 
results. Each of these two strategies were used with and without a 
narrative presentation before each lesson to make the third and fourth 
experimental training conditions. 

At the end of training and after Completing an attitude questionnaire 
about their CAI training experience, all four groups took th«r- BE/E 
School's examination on AC Series Circuits and a supplementary "cest 
comprised of school objective criterion questions not rt^presented on the 
examination. 

Findings and Conclusions 

No significant differences were found between the foui* exp^-^rimental 
conditions in test perfomiance or training time measures. Question- 
naire data indicated that students who selected their own training 
maintained a significantly more favorable attitude toxmrd CAI. In 
addition, students who had a pre-training narrative available to them 
felt that it was a valuable aid. 
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The best indicators of CAI training success were scores on prev.ious 
school examinations and prior time spent in the BE/E School's individ- 
ualized training curriculum. Performa.ice on the CAI module was not 
significantly related to General Classification Test scores or two 
aptitude measures. 

The findings reported here are the first of two studies designed to 
evaluate the effectiveness of prc.-ram controlled versus studont con- 
trolled CAI training strategies. Research now in progress will evaluate 
these factors in lesson remediation training. 
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A COMPARISON OF STUDENT OPTION VERSUS 
PR0GRAI4 CONTROLLED CAI TRAINING 



I. Introduction 

Slough, Ellis, and Lahey (197^) have indicated that additional per- 
rormance improvement over classroom instruction can be accomplished by 
individualizing computer assisted instruction (CAI) lesson presentation. 
l-Jhen branching instructions are used to permit "bypassing instruction that 
more knowledgeable students do not need, group performance improves signif- 
icantly both as to time spent and terminal performance. If "branch^nr is as 
effective as these studies have indicated, one may ask how authors shouj-d 
control branching. Hiirlock* s study (1972) used pretesting as a criterion 
for making a program-controlled "skip-ahead" or "minimal -maximal training" 
decision. Slough, ElliSs and Lahey (1972) used a dual --criterion test of 
performance (branch to additional training if .vrcng; choice to branch or 
not branch if correct) for basic control, with a student option for review 
and practice. 

Studies of instructional strategies have not yielded conclusive evidence 
showing a consistent advantage of one strategy over another based on final' 
examination performance. Diibin and Taveggia (1968) have labeled this find- 
ing the "teaching-learning paradox;" they believe there is no difference 
among truly distinctive methods in college instruction as measured by final 
examination scores. Davis, Marzoco , and Denny (1970) foiind that modes of 
presenting programmed instruction did not produce significantly different 
learning outcomes nor significant interactions. The modes of presentation 
were overt versus covert responding and constructed response versus mixltiple 
choice. Subjects allowed to choose their own treatment modes did not per- 
form significantly better than subjects whose treatments were experimenter 
assigned. Further, with the exception of reading, there were no significant 
interactions with five individual difference measures. 

Peeck (1970)5 on the other hand, found that prequest ioning produced 
significantly better ^-deiy retention Cx question relevant prose content 
than equal prequestion reading time. He suggested that prequestion facil- 
itation of later learning will occur only if the subject remembers the 
question or recognizes training content as relevant to them. A similar 
study (Deno , Jenkins, and Marsey, 1970) demonstrated that learning to 
identify and label the attributes on a subject matter concept prior to 
training strongly influenced subsequent performance on transfer tasks 
involving those concepts. Grotelueschen and Sjogren (1968) concluded that, 
with adults or superior ability, advance organizers may produce facilitative 
effects on, complex learning tasks. Allen (1970 ) reported a similar effect 
using advance organizers of approximately 300 words in length written to 
serve as both expository and comparative organizers. In another comparison 
of teaching strategies (Coop and Brown, 1970) a teacher structured presenta- 
tion method of instruction was significantly superior to an independent 



problem-solving method of instruction on three achievement measures, 
Hurlock (1972) reported that pretest branching instructional designs 
provided two to four times more training experience to the slow learner 
than to th'i: fast learner. 

This study compared two instructional strategies for individualizing 
lesson training materials and evaluated the effect of reading a lesson 
narrative before training. The two individualized designs were student 
option , where the student was allowed to choose his own training, and 
program control , where lesson programming logics selected the student's 
training based on his performance on a pretest. It was hypothesized that 
the availability of a narrative before' each lesson would significantly 
enhance student performance during training. It was also predicted that 
the individualized training strategies, student option or program control, 
with the prelesson narrative would produce significantly higher test per- 
formance and/or shorter training time than their control conditions without 
the narrative. 



II. Method 

A. Design 

A 2 X 2 factorial design was used to investigate the influence of two 
pretraining and two training conditions on performance scores and training 
time. Random assignment of 96 students ainong the four experimental condi- 
tions allotted an n^ of 2k students per cell (Table l). The two pretraining 
conditions were: (l) a narrative overview read before each CAI modixle 
lesson and (2) a non-narrat ive control condition. The two training condi- 
tions were: (l) student option , where each student selected his own train- 
ing sequences for each lesson and (2) program control , where branching to 
training was program controlled by each student's pretest performance on 
each lesson training objective. 



TABLE 1 

Assignment of Students to Experimental Condition 







Pretraining 


Condition 


Training 


I Condition 


Narrative 


Non-Narrat ive 


Student 


Option 


n.= 21+ 


n = 21+ 


PrograiJ 


Control 


n ^ 21+ • 


n = 21+ 



CAI Le.^sons 1 and 2 were the same for all S_s; CAT Lessons 3-11 employed 
the experimental design shovia in Table 1. Each lesson vas followed by a 
lesson test that was scored and reviewed for the student. Students failing 
to reach a lesson score criterion level received remediation before con- 
tinuing to the next lesson. 

B. Subjects 

All 96 students were Navy trainees in the Basic Electricity/Electronics 
(BEE/E) School, Service School Command, Naval Training Center, San Diego, 
California. During the experimental period, arrangements were made to 
have trainees at the appropriate time sent to the CAI room to receive the 
CAI ^^AC Series Circuit" Module. This procedure was followed \intil the 
necessary 96 students were obtained. 

C . Equipnent 

The CAI AC Series Circuit Module was presented on the IBM I5OO Instruc- 
tional System located at Naval Training Center, San Diego. Each student 
terminal had a CRT display for presenting training material with a keyboard 
and light pen for making responses, and an image projector for auxiliary 
graphics. The instructional system consists of 16 student terminals. Of 
these, 12 to 13 were used by students in this study , and one as a proctor 
station to monitor student progress. 

D. CAI Training Materials - 

The CAI training module used in the study was part of a previously 
operationally tested CAI module, the AC Series Circuits and Resonance 
Module which corresponded to training objectives taught in the BE/E School. 
Modifications for the study included adding training objectives not present 
and deleting training objectives not included in the newly adopted, self 
instructional, self paced school curriciilum. The result was a CAI modiile 
containing 11 lessons, called the CAI AC Series Circuit Module. 

Beginning with Lesson 3, each lesson was revisecl into two versions 
using different training strategy designs, "Student Option" and "Prograju 
Control." The Student Option design presented the student with a list or 
index of topics on the CRT screen from which he could choose his own topic, 
sequence, and amoujit of instruction. Each lesson objective was represented 
by one or more topics. When the student chose a topic, he was imir.ediately 
branched to a sequence of training frames for that area. After con'i_;7 i.et ing 
a sequence of insti^uct ion , he was branched back to the index list of L.^pics 
A student could repeat any topic as many times as desired, or he could skip 
fajniliar topic^ and go directly to the lesson test. 

The Program Control design started with pretest ii-jg- Students were 
given one or more questions covering each topic in the student option 
lesson design. The student answering a pretest correctly was branched to 
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the next pretest; if he failed, he was branched to the appropriate instruc- 
tional sequence. The student could elect not to answer the pretest ques- 
tion(s) and go immediately to the training. Students were always given 
training immediately after a failure or upon electing to receive instruc- 
tion. 

Both the Student Option and Program Control designs used identical 
training sequences for each lesson objective. The only difference in the 
lesson versions was "how'^ a student got bo the training sequences. In the 
Student Option design students chose their training topics; in the Program 
Control design students were branched to the training sequence as a result 
of low pretest performance or electing to receive the training. Lessons 
and 2, which were the asme for all students, employed a fixed sequence 
design with limited branching from mainline pr^entations . 

CAI Lesson Tests were automatically scored on line. Students saw their 
test score displayed on the CRT screen. If errors were made, -the student 
was branched to a display of the test question with the correct solution. 
Test questions were usually multiple choice requiring light pen responses. 

Following lesson test scoring and wrong answer feedbacks, students 
were branched to short program controlled remediation sequences to 
strengthen their understanding of topics missed in the lesson test. 
Students received additional training specific to errors made on the lesson 
test. Whether a student received remediation on a particular lesson was 
based on a cut-off score. After remediation, the student advanced to the 
next lesson. 

E. Off-Line Training Materials 

The narrative consisted of separately bound, technically complete 
lesson material for CAI Lessons 3-11. Lesson narratives were designed so 
that a student could meet all lesson objectives without taking the CAI 
lesson. Narratives varied in length from 3 to ik pages, in some cases 
including practice exercises, but not programmed instruction materials. 
Narrative materials were kept at the student terminals. 

The students were also provided with Study Guides for CAI Lessons 1-11. 
This material consisted of brief 2-3 page summaries foi' each lesson that 
the student could take with him. Study Guide summaries were not intended 
to be *'stand-al*bne , " technically complete presentations. Occasionally the 
Study Guide was integrated into the CAI lesson; the student was required 
to fill in blanks or look at explanatory illustrations within the Study 
Guide. Typically the Study Guide contained a list of lesson objectives, 
sample problems, definitions and rules. 

F. Evaluation Tests 

Two major tests were used to evaluate student comprehension, the BE/E 
School's Examination and a supplementary test. The supplementary test was 
given to each student after Cii)mpleting the 11 lessons of the CAI AC Series 



CAI Lessons 1 and 2 were the same for all S_s; CAI Lessons 3-11 employed 
the experimental design shown in Table 1. Each lesson was followed by a 
lesson test that was scored and reviewed for the student. Students failing 
to reach a lessor, score criterion level received remediation before con- 
tinuing to the next lesson. 

B. Subjects 

All 96 students were Navy trainees in the Basic Electricity/Electronics 
(BEE/E) School, Service School Command, Naval Training Center, San Diego, 
California. Diiring the experimental period, arrangements were made to 
have trainees at the appropriate time sent to the CAI room to receive the 
CAI "AC Series Circuit" Module. This procedure was followed until the 
necessary 96 students were obtained. 

C. Equipment 

The CAI AC Series Circuit Module was presented on the IBM I5OO Instruc- 
tional System located at Naval Training Center, San Diego. Each student 
terminal had a CRT display for presenting training material with a keyboard 
and light pen for making responses, and an image projector for axixiliary 
graphics. The instructional system consists of I6 student terminals. Of 
these, 12 to 13 were used by students in this study, and one as a proctor 
station to monitor student progress. 

D. CAI Training Materials 

The CAI training module used in the study was part of a previously 
operationally tested CAI module, the AC Series Circuits and Resonance 
Module which corresponded to training objectives taught in the BE/E School. 
Modifications for the study included adding training objectives not present 
and deleting training objectives not included in the newly adopted, self 
instructional, self paced school curriculum. The result was a CAI module 
containing 11 lessons, called the CAI AC Series Circuit Module. 

Beginning with Lesson 3> each lesson was revised into two versions 
using different training strategy designs, "Student Option" and "Program 
Control." The Student Option design presented the student with a list or 
index of topics on the CRT screen from which he could choose his own topic, 
sequence, and amount of instruction. Each lesson objective was represented 
by one or more topics. When the student chose a topic, he was immediately 
branched to a sequenct Ox training frames for that area. After completing 
a sequence of instruction, he was branched back to the index list of topics 
A student could repeat any topic as many times as desired, or he could skip 
familiar topics and go directly to the lesson test. 

The Program Control design started with pretesting. Students were 
given one or more questions covering each topic in the student option 
lesson design. The student answering a pretest correctly was branched to 



the next pretest; if he failed, he was branched to the appropriate instruc- 
tional sequence. Th€. student could elect not to answer the pretest ques- 
tion(s) and go immediately to the training. Students were always given 
training immediately after a failure or upon electing to receive instruc- 
tion. 

Both the Student Option and Program Control designs used identical 
training sequences for each lesson objective. The only difference in the 
lesson versions was "how" a student got to the training sequences. In the 
Student Option design students chose their training topics; in the Program 
Control design student s^were branched to the trainings sequence as a result 
of low pretest performance or electing to receive the training. Lessons 
1 and 2, which were the asme for all students, employed a fixed sequence 
design with limited branching from mainline pr-^entat ions . 

CAT Lesson Tests were automatically scored on line. Students saw their 
test score displayed on the CRT screen. If errors were made, the student 
was branched to a display of the test question with the correct solution. 
Test questions were usually multiple choice requiring light pen responses. 

Following lesson test sco'ring and wrong answer feedbacks, students 
were branched to short program controlled remediation sequences to' 
strengthen their understanding of topics missed in the lesson test. . 
Students received additional training specific to errors made on the lesson 
test, r Wliether a student received remediation on a particular lesson was 
based on a cut-off score. After remediation, the student advanced to the 
next lesson. 

E. Off -Line Training Materials 

The narrative consisted of separately bound, technically complete 
lesson material for CAI Lessons 3-11- Lesson narratives were designed so 
that a student could meet all lesson objectives without taking the CAI 
lesson. .Narratives varied in length from 3 to ih pages, in some cases 
including practice exercises, but .not programmed instruction materials. 
Narrative materials were kept at the student terminals. 

The students were also provided with Study Guides for CAI Lessons 1-11. 
This material consisted of brief 2-3 page summ3.ries for each lesson that 
the student could take with him. Study Guide summaries were not intended 
to be "stand-alone," technically complete presentations. Occasionally the 
Study Guide was integrated into the CAI lesson; the student was required 
to fill in blanks or look at explanatory illustrations within the Study 
Guide. Typically the Study Guide contained a list of lesson objectives, 
sample pi'oblems, definitions and rules. 

F. Evaluation Tests 

Two major tests were used to evaluate student comprehension, the BE/E 
School's Examination and a supplementary testn The supplementary test was 
given to each student after completing the 11 lessons of the CAI AC Series 



Module, The purpose of this test was to measure achievement on lesson 
objectives taught in the CAI modui.e hut not covered in EE/E School's 
examination. The test consisted of 20 multiple choice questions. It was 
taken off-line and hand scored by the experiment proctor who reviewed the 
test with each student. The second test was the BE/E School's (Module) 
examination; it was administered after the supplementary test. This test 
contained UO multiple choice questions, 

G, Procedure 

The. study proctor explained the general nature of the experiment and 
advised students that the CAI module usually took between two and four 
days, to complete. Students were told not to take notes or make intentional 
errors in responding. Instruct ion on the use of lesson narratives stated 
that narratives were to be read before each lesson (starting with Lesson 3) 
and that the narrative should not be referred to after starting a lesson. 
The students were issued Study Guides with the order of lessons listed. It 
was explained that each lesson is followed by a lesson test and that breaks 
should be taken at the end of each lesson or at least once per 30 or 
minutes. 

After completing the 11 CAI lessons, each student was given a question- 
naire to complete (see Appendix B), The questionnaire differed for the 
students in the narrative and non-narrative -conditions. After completing 
the questionnaire, each student took the supplementary test and the school^ s 
examination. 



III, Results 

A, Background and Pretraining Measures 

Background data from three aptitude tests, the Electronics Technicians 
Standard Test (ETST), the arithmetic test (ARl), and the General Classifica-- 
tion Test (GCT), reported as standard scores are summarized in Table 2. 
These data were obtained from school records as well as previous school 
examination scores and previous training time. The previous exr.minations 
data shown in Table 2 was calculated by dividing the total number of cor- 
rect answers by the total number of test questions on 11 school examina- 
tions taken before CAI training. The previous training time data was 
obtained by multiplying the number of days spent in training by 5-5 hoin^s, 
the duration of a daily shift. 
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TABLE 2 



Background Measures 



Test Scores and Previous 
Training Time 


Program Control 




student Option 


Narrative 


Non-Narrative 




Narrative 


No n~ Narrative 




M 




M 


GD 




M 


SD 


M 


SD 


Electronics Technician 
Select ion Tegt (ETTST) 


65.0 


6.T 


63.5 


3.7 




6I4.8 


5.8 


63.0 


5.9 


Arithmetical Reasoning 
Test (AHI) 


61,0 


5.3 


59.8 


i*.3 




60.7 


5.6 


59.8 


5.6 


General Classification 
Test (GCT) 


63.3 


6.1 


63. T 


3.3 




61.3 


I4.8 


61.7 


h.Q 


Previous Examination 


90. 14 


5.1 


89.3 


1:>.0 




90,0 


3.6 


89.9 


i4.3 


Previous Training Time 
(Min. ) 


819.0 


293.8 


866.1 


227.^4 

■ 


u 


79^4.3 


258.3 


7^6.3 


300.9 



CAT Performance Measures 

1 • Major Examination .^^ 

A multivariate analysis of variance and covariance (Biomedical 
Computer Program Series, UCLA, BMDX69) was done on performance measures. 
No significant differences were found for the four experimental groups on 
module examinations and supplementary test scores. Table 3- 

TABLE 3 
Module Test Scores {%) 





Program Control 




Test 


Narrative 


Non-Narrative 


Narrative 


Non-Narrat ive 




M 


SD 


M 


SD 


M 


SD 


M 


SD 


Supplementary- 
Module Final 


86.7 
8I4.5 


13.1 
12.0 


88.6 
85.5 


11.2 
9.6 


88.5 
83.8 


11.7 
10.9 


85.2 
82.5 


10.8 



2. Lesson Tests 

The grand lesson score (computed by dividing the total number of 
correct answers in Lessons 1 through 11 by the total number of lesson test 
questions) did not differ between treatments (see Table k) . Ko differences 
were found between groups on control Lessons 1 and 2, 
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TABLE k 
Lesson Scores {%) 







Control 






Student Option 


Lesson Ko . 






TClt IyO 


narrative 


Hon-IIarrative 




M 


SD 


M 


SD 


M 


SD 


M 


SD 


1 


95.^ 


7.7 


9^.5 


7.5 


91.5 


13.^4 


93.1 


10.5 


2 


79. 8 


lU.2 


83.0 


10.7 


86. U 


11.3 




10. 3 


3 


81i.9 


13.8 


86.8 


10.9 


90.1 


7.1 


82.9 


10.1 


h 


80. 3 


11.8 


82.6 


1^4.3 


85.7 


9.0 


85.5 


12.3 


5 


35.2 


15.6 


8li.8 


13.7 


8U.5 


11.9 


87.5 


14.7 


6 


Qh.Q 


18.8 


90. 8» 


11.1 


93.6* 


6.5 ' 


85.5 


11.5 


7 


16.6 


22 . \ 


Qh.k 


17.7 


81.8 


15.0 


8U.8 


13.3 


8 


71.3 


20.5 


63.3 


15.2 


73.8 


20.8 


63.3 


22.0 




70.3 


23.8 


77.6 


17.7 


85.8 


1^4.5 


76.3 


22.0 


10 


89.6 


10.3 


8U.8 


13.1 


91.2 


9 1 


91.9 


8.6 


11 


8ii.7 


13.5 


87.5 


11.6 


86.5 


11.6 


8U.7 


8.9 


Grand Les- 
son Score 


82.7 


13.5 


8U.5 


6.h 


87.3 


6.1 




6.3 



^Interaction F = 7-75, if = 1/96, p_ <.01 



3. CAT Training Time 

Only Lesson 10 took significantly less time for two experiment al 
treatments (F = 12.56, df = 1/96, p<.00l)5 Table 5. Lesson training time 
is the time spent from the start of the lesson to the end of the lesson 
test. Other times computed by experimental conditions vere : 

Total Traininf^ Time - or the actual time spent on the CAT 
system by the student. It excludes remediation vhich may 
have followed the lesson test. 

Module Training Time - the total training time plus time 
spent on breaks, in remediation after lesson tests, and 
in review between lessons. It is the clock time spent 
at the CAI facility from the start of Lesson 0 to the 
conclusion of Lesson 11. 

Time Attended -..the total time the student spent at the CAI 
facility including time taken to review for and complete 
the supplemental and module tests. 
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TABLE 5 

Lesson Training Time (Minutes) 





Fr'ogran: 


Control 






Student Option 


Lesson IIo . 




.ive 




Narrative 


Non-Narrative 




li 


SD 


I'' 


SD 


M 


SD 


M 


SD 


1 


29. h 


^ . ( 


26. k 


6.5 


28. U 




30,1 


7.2 


2 


U3.g 


9.5 


U3.I 


9.7 . 


U5.6 


17.8 


U8,3 


17.3 


3 


78.0 


25.7 


82.0 


2*1.7 




3^,3 


80.9 


52.6 


k 


112.7 


35.6 




52.1 


118.2 




111,1 


^9.0 


5 


k5.9 


lU.l 


UG.k 


11.9 


U3.8 


18, U 


U0.7 


16.8 


6 


k3.k 


17.1 


kh,i 


15.8 


U8.5 


28, U 


U6.8 


25.9 


T 


29.5 


8.6 


32.9 


13.3 


28.7 


11, U 


30.1 


13.3 


8 


3h,9 


19.5 


28> 


13.1 


50.9 


ill. 9 


39.^ 


20.8 


9 


29.5 


13.^ 


28.5 


13. ii 


31.2 


17.3 


31.8 


13.5 


10 


52.6^ 


12.2 


55.0^ 


16.1 


67.6 


27.1 


69.6 


51.3 


11 


59.3 


19.9 


65.6 


25.0 


SO. 5 


21,3 


58.2 


20, li 


All 


















Lessons 


50.8 


15-2 


5^1.0 


18.3 


5.-^.8 


25.9 


I 53.il 


23.5 



F = 12.56, df = 1/96, 2. < '00^- 



Time in Other Activities - the time spent in activities 
other then CAI training. It is equivalent to the 
"Attendance" minus the "Module Training Time,'* 

Pretrai.T^iig Time - the time spent reading narratives, taking 
pretests and reviewing student options. 

TalDle 6 summarizes the mean student times for these categories. 
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TABLE 6 
Training Time 



Time 
(Hoiirs -Minutes ) 


Program Control 




Student Option 


Narrative 


Non-Narrative 




Narrative 


Non-Narrative 


M 


SD 


M 


SD 




M 


SD 


> 


I 

SD 


Hours Trainiiig 


9:38 


1:30 


9:5^ 


2\2k 




9:52 


3:U3 


9:^7 


3:19 


M-.1'i1.e Training 


11:142 


? oa 


12:0^ 


2:33 




11:U0 


k:ie 


12:10 


3:59 


A tit en dance 


1^^:18 


3:10 


15:12 


3:20 




lU:56 


5:33 


15:35 


p:19 


Other Activities 


3:l8 


2;00 


3:12 


1:50 




3:16 


1:55 


3:25 


2:0l^ 


Pretraining 


0:ll+* 


0:05 . 


0:08* 


0:03 




0:08* 


0:0U 


0:02* 


0:01 



*Only pretraining times varied significantly "between experimental conditions, 
narrative vs. non-narrative (F = 52.6, df = 1/96, 2_<.00l) and program 
control vs. student option (F = 52.65, d = 1/96, £^<.00l). 



C . Correlational Analysis 

Correlational analyses were performed between the backgroiind measures 
(previous examinations, previous training time, ETST, ART, OCT) and over- 
all CAT performance measures (Table ?)- Previous school examination scores 
were the Vest predictors of CAT test performance; prior school training 
time was the best predictor of CAI training times - 



TABLE 7 

Correlation Between Background Measures and 
Overall CAI Perfomance Measures 





Total 


Module 


Hours 


Grand Lesson 


Supp 


BE/E 


Background Measures 


Tr . Time 


Time 


Attended 


Score 


Test 


Exam 


Previous School Exams 


-0.191 


-0.203 


-0.356 


O.5UO 


0. 1+1+9 


0.629 


Previous Training 








-O.33U 


-O.2I+7 


-0.368 


Time 


0.505 


O.5UU 


0,5^^ 


ETST 


-0.359 


-0.370 


-O.U75 


0.370 


0.289 


0.1+11 


ARI 


-0.276 


-0.2U7 


-0.293 


0.371 


0,382 


0.395 


GOT 


-0.356 


-0.357 


-0.357 


0.159 


0.229 


0*258 
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D. Student Attitude Questionnaire 

An analysis bf the Evaluation Questionnaire, Appendix B, was prepared 
from student reactions to the CAI instructional system. Table 8. This 
data is based on 12 student questionnaires or 18 per experxinental condition, 



TABLE 8 

Student Responses to Evaluation Questionnaire. 



Qaestion Ho . /F^t^ing 



1. How much did/wor.ld 
the narrative have 
helped you? 
(Rated t'roci 

<10% 90';) 

2. Would the Study 
Guide have served 
as a narrative? 
(Yes = 1, no = 0) 

3. Would you prefer to 
have training 
selected fot you? 
(Yes = 1, No = 0) 

Did you get enough 
ren^ediation? 
(Never-alwaySt 0-U) 

5- How would you divide 
your time? {%) 
BEEIIJLES 
CAI 

Classroom 
Other 

6. How do you rate 
CAI? 

(Poor - out stand- c 
ing, 0-U) 



Cont.rol 



larrat iv^i 



(1) 



2.3* 



0.3 



0.3 



(1) 



2.9 



37.7 
U9.6 
11.1 
1.7 



2,1* 



lion- 
Narrative 



•£<.01, F = 9.6, dX = 1/71 
•»£<.001, F = 3l».0, dV_ = 1/71 
(l) interaction, £<.0? 



1.3 



0.5 



0.5 



3.1 



28.0 
66.8 
1.2 
1.5 



3.0 



'otviuer.t 
Option 



Jarrative 



2.3* 



0.1* 



o.u 



3.1 



3U.1* 
62.2 
2.8 
0.6 



3.1** 



IJon- 

Narrative 



0.8 



0.6 



O.U 



3.2 



26. 1» 
65.5 

8.1 

0 



3.2* 
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TABLE 6 
Training Time 



Time 
(Hours -Minutes ) 


Program 


Control 






Student 


Option 




Narrative 


Non--Karrative 




Narrative 


Non-Narrative 




M 


SD ' 


M 


SD 




M 


SD 


M 


SD 


Hours Training 




1:30 




2:2U 




9:52 


3:U3 


9:i*7 


3:19 


Module Training 


11 : h2 




12:03 


2:33 




11:U0 




12:10 


3:59 


Attendance 


15:13 


3:18 


15:12 


3 = 20 




111: 56 


5:33 


15:35 


5:39 


Other Activities 


3:l8 


2;00 


3:12 


1:50 




3: 16 


1:55 


3:25 


2:0U 


Pretraining 


0:lU* 


0:05 


0;08* 


0:03 




0:08* 


0:0U 


0:02* 


0:01 



*Only pretraining times varied significantly between experimental conditions, 
narrative vs. non-narrative (F = 5?. 6, df = 1/96, £<.00l) and program 
control vs. student option ( F = 52 .65 , df = I/96, £< .001 ) . 



C. Correlational Analysis 

Correlational analyses were performed between the background measures 
(previous exsuninations, previous training time, ETST, ARI, GCT) and o^'Br- 
all CAI performance measures (Table 7)* Previous school examination scores 
were the best predictors of CAI test performance; prior school training 
time was the "best predictor of CAI training times. 



TABLE T 

Correlation Between Background Measures and 
Overall CAI Performance Measures 





Total 


Module 


Hours 


Grand Lesson 


Supp 


BE/E 


Background Measures 


Tr. Time 


Time 


Attended 


Score 


Test 


Exam 


Previous School Exams 


-0.191 


-0.203 


"O.356 


O.5UO 


O.UU9 


0.629 


Previous Training 








-0.33li 


-0.21^7 


-0,368 


Time 


0.505 


O.5UU 


O.5UU 


ETST 


-0.359 


-0.370 


-0.1+75 


0.370 


0.289 


0.i*ll 


ARI 


-0.276 


-O.2U7 


-0.293 


0.371 


0.382 


0.395 


GCT 


-0.356 


-0.357 


-0.357 


0.159 


0.229 


0.258 
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D. 



Student Attituae (<^uest ionnaire 



An analysis of the Evaluation Questionnaire, Appendix B, was prepared 
from student reactions to the CAI instructional system, Ta"ble 8. This 
data is based on 72 student questionnaires or 18 per experimental condition. 



TABLE 8 

Student Responses to Evaluation Questionnaire 



Question llo * /l^.ii^ in^ 


Cont.rul 


Student 
Option 






r.'cn 


rative 


tJarrative 


Noa- 

. HaVrative 


1, How much did/wonld 
the narrative have 
heaped you? 
{Raned tYoci 0-U, 
<10% 905) 


(1)" 

2.3«» 




1.3 


2.3»» 






0.8 


2. Would the Study 
Guide have served 
as a narrative? 
\ Yes - -i. J rjo — u J 


0.3 






0.5 


O.U 






0.6 


3. Would you prefer to 
have training 
selected for you? 
, (Yes = 1, No = 0} 


0.3 






0.5 


O.U 






0.1» 


U. Did you get <?nough 
remediation? 
(Kever-always, 


(1) 

2.9 






3.1 


3.1 






3.2 


5. How would you divide 

your time? (5!) 
f BEEirJLES 
CAI 

Classroom 
Other 


37.7 
U9.6 
11.1 

. 1.7 






28.0 
66.8 
1.2 
1.5 


3U.U 
62.2 
2.8 
0.6 






26. U 
65.5 
8.1 

0 


6. How do you rate 
CAI? 

(Poor - outstand- 
ing, O'U) 


2.U 






3.0 


3.U« 






3.2« 



*£<.01, F = 9*6, df = 1/71 
•*£<.001. F = 3i*.0, df = im 
(l) interaction, 
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IV, Discussion 



No evidence of the superiority of either of the four training 
strategies, narrative vs. non -narrative, program control vs. student 
control, was found in performance scores or training time. The differences 
in pretraining time for subjects using the narratives disappeared as train- 
ing progressed, as reflected by overall training times. Table 6, There 
was no overall benefit from use of the narratives as shown by overall test 
scores, Table 3* 

As can be seen from Table Tj time spent in Basic Electric ity/Electz'onics 
School prior to CAI training was the best predictor of training tLmes. The 
grand score on previous examinat j ons also proved to be the best predictor 
of overall performance measures. The ETST, GCT, and ART scores were not as 
goc L performance predictors as previous performance. 

Looking at the mean pretraining time of eight minutes for students 
who had narratives available to them. Table 6, raises some doubt as to hovr 
extensively the narratives were used. Each narrative was designed as 
self-contained material that met lesson objectives to the point where a 
fast student could succeed on lesson tests. It was not anticipated that 
students would spend less than one minute reading them. If there was any 
preorganizat ion done for the student who read the narrative, it did not 
seem to influence performance scores or time significantly. 

As seen from Question 1, Table 8, those students who had narratives 
felt they were valuable aids. Question 6, Table 8, revealed a positive 
attitude toward CAI by the student option group which was not shared by 
the program control group. Student freedom to control instruction may 
promote a positive attitude toward training, but in this study it did not 
improve performance or reduce training time. 

It may be that the effects of allowing the student to select his own 
training sequences and providing him pre-lesson narratives are largely 
motivational. Given a longer training period, it is possible that the 
student's positive attitude would result in performance superior to program 
directed instruction. Conversely, it may be that student chosen sequencing 
would never prove superior and that student motivation could be increased 
by offering appropriate incentives and rewardj for the student. Rather 
than rely on either program or student control training, it may be more 
important to change the total training environment to attract, sustain, 
and reward the student. 

From this study, it is apparent that student controlled and program 
controlled instruction are equally effective. Further investigation of 
the students' appraisal of program and student controlled instruction 
given an opportunity to experience both would be required. The response 
to Question 1 (Table 8) may have been difficult to answer for those 
students without the pre-lesson narratives. Giving a narrative to all 
students who experience both instructional strategies would be worth more 
study. Application of the experimental design to remedial training after 
lesson tests in combination with these lesson strategies might point to 
O the significant strengths of each. 
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Appendix A 
Modiile 12 - AC Series Circuits 



-Control Lessons 



Lessons 

(SC~0) Introduction to CAI 

A (SC--1) Phase Relationships 

B (SC--2) Impedance 

C (SC-3) Trigonometric Functions 

D (SC-^) Circuit Analysis 

E (SC-5) Vector Notation 

F (SC-6) Conversion of Vector Notation 

G (SC~T) Power 

I (SC~8) Variational Analysis 

J (sC-9) Variational Analysis for Pover 

K (SC~10) Frequency Discrimination in RL Circuits 

L (SC~ll) Frequency Discrimination in RC Circuits 
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Appendix B 



CAI Experimental Course (SC-Mod 12) Student Number 

Evaluation Questionnaire (X) for 
Non-Narrative Students 

1. If you had had a narrative to read before each CAI lesson (like you 
use in the BEEINLES), how much would it have helped or xinproved your 
learning? 

none (lO^l) some {2k%) half (50^) much (75^) all (90^) 

2. V/ould the Study Guide have served as well as a Narrative if you had 
read it before starting each lesson? 

Yes 

No 

3. If you had your choice, would you prefer choosing your instruction op 
the computer or would you prefer to be pretested and have the computer 
decide instruction? 

prefer self selection of trainingr. 

prefer computer controlled selection of training (pretesting). 

■k. Did you feel that you received enough remedial practice on incorrect 
lesson test questions? 

never .enough (lO^ or less) 

sometimes enough (25^) 

half the time {^0%) 

• usually enough (75^) 

always enough (90%) 

5. Choose the kind of instruction you would like to receive for BE/E 
training and show percentage of time you would like to spend with 
each. (You may prefer one or more of training. ) 

% BEEINLES 

% CAI 

% Class Instruction with textbook 

% Other (specify) ^ 

6. Rate CAI training: (mark appropriate blank) 

poor fair average above average outstanding 

7. Remarks (likes, dislikes, suggestions for improvement other comments): 



ERIC 



Appendix B 

CAI Experimental Course (SC-Mod 12) Student Nimber 

Evaluation Questionnaire (k) for 
Narrative Students 

1. We are interested in your opinion of the use of a narrative (pretraining) 
"before taking a CAI lesson. How much did it help you learning of lesson 
objectives? 



none (10^-^) some {2h%) half (50^) much {15%) all (90^) 

2. Woiild the Study Guide have served as well as the Narrative if you had 
read it before starting each lesson? 

Yes 

No 

3. If you had your choice, would you prefer choosing your instruction on 
the computer or would you prefer to be pretested and have the computer 
decide instruction? 

prefer self selection of training. 

^ prefer computer controlled selection of training (pretesting). 

k. Did you feel that you received enough remedial practice on incorrect 
lesson test questions? 

never enough ilO% or leGs) 

sometimes enough (25^) 

half the time (50^) 

usually enough (T5^) 

always enough (90^) 

5. Choose the kind of instruction you would like to receive for BE/E 
training and show percentage of time you would like to spend with 
each. (You may prefer one or more types of training. ) 

% BEEINLES 

^ CAI 

% Class Instruction with textbook 

% Other (specif^O 

6. Rate CAI training: (mark 'appropriate blank) 

poor fair average above average outstanding 

7. Remarks (likes, dislikes, suggestions for improvement, other comments): 
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The goals of this study were (l) to compare two instructional strategies for 
individualizing computer assisted instruction (CAl) training materials and (2) to 
evaluate the effect of providing a lesson "narrative before training. 

This development effort i^ a part of a prograjn In which a number of CAI instructional 
strategies are being developed and tested for basic electronics training. Two types 
of adaptive instructional strategies were compared: (l) the student selected his own 
training and (2) the cours^ program controlled training for the student based on his 
pretest results. The influence of having the student read a narrative overview of 
training content before CAI instruction on each lesson was also examined. The subject 
matter consisted of AC series circuits in the Basic Electricity/Electronics (BE/E) 
School, and the course materials vehicle was a modified version of the previously 
developed CAI "AC Series Circuits and Resonance Module." 

No significant differences were found between the four experimental conditions in 
test .performance or training time measures- Questionnaire data indicated that students 
who selected their own training maintained a significantly more favorable attitude 
toward CAI. In addition , "students who had a pre-training narrative available to them 
felt that it was a valuable aid. 
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